Image processing method displaying processed image representing result of color modification process

ABSTRACT

An image processing method includes: (a) displaying a plurality of candidate image processes to be performed on image data, the plurality of candidate image processes including a color modification process; (b) receiving an instruction indicating the color modification process selected from among the plurality of candidate image processes; (c) displaying a display image corresponding to the image data on the display; (d) designating a display image; and (e) displaying a processed display image that represents a result of the selected color modification process performed on the image data corresponding to the designated display image before the selected color modification process on the image data corresponding to the designated display image is performed.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. application Ser. No.14/516,637, filed Oct. 17, 2014, which is a continuation of U.S.application Ser. No. 14/076,154, filed Nov. 8, 2013, now U.S. Pat. No.8,866,844, which is a continuation of U.S. application Ser. No.13/692,671, filed Dec. 3, 2012, now U.S. Pat. No. 8,581,928, which is adivisional of U.S. application Ser. No. 12/153,841 filed May 27, 2008,now U.S. Pat. No. 8,325,204, which claims priority from Japanese PatentApplication No. 2007-163768 filed Jun. 21, 2007. The entire contents ofthe above noted applications are incorporated herein by reference.

TECHNICAL FIELD

The invention relates to an image processing apparatus, an imageprocessing method, and an image processing program and, moreparticularly, to an image processing apparatus, an image processingmethod, and an image processing program allowing a user to readilyvisually confirm a result of determined image process and having goodoperability.

BACKGROUND

Image processing apparatuses capable of applying various image processessuch as color tone correction or rotation to image data taken by anelectronic camera, for example, are well known in the art. Such imageprocessing apparatuses display thumbnail images which are reduced imageson the screen thereof so as to allow a user to confirm a plurality ofinput image data at sight. One such image processing apparatus disclosedin Japanese Patent Application Publication No. 2000-215322 appliespredetermined image process to a thumbnail image that has been selectedas image data to be processed by a user and displays a result of theimage process on the screen thereof.

SUMMARY

However, in most cases, the user determines, through a trial and errorprocess, which image process is to be applied to respective image data.Thus, the conventional arts disclosed in Japanese Patent ApplicationPublication No. 2000-215322 make user operation cumbersome andcomplicated.

In order to attain the above and other objects, the invention providesan image processing method. The image processing method includes: (a)displaying a plurality of candidate image processes to be performed onimage data, the plurality of candidate image processes including a colormodification process; (b) receiving an instruction indicating the colormodification process selected from among the plurality of candidateimage processes; (c) displaying a display image corresponding to theimage data on the display; (d) designating a display image; and (e)displaying a processed display image that represents a result of theselected color modification process performed on the image datacorresponding to the designated display image before the selected colormodification process on the image data corresponding to the designateddisplay image is performed.

According to another aspects, the invention provides an image processingapparatus. The image processing apparatus includes a display, a processdisplay unit, a process receiving unit, an image display unit, and animage designating unit. The process display unit is configured todisplay on the display a plurality of candidate image processes to beperformed on image data. The plurality of candidate image processesincludes a color modification process. The process receiving unit isconfigured to receive an instruction indicating the color modificationprocess selected from among the plurality of candidate image processes.The image display unit is configured to display a display imagecorresponding to the image data on the display. The image designatingunit is configured to designate a display image. The image display unitis configured to display a processed display image that represents aresult of the selected color modification process performed on the imagedata corresponding to the designated display image before the selectedcolor modification process on the image data corresponding to thedesignated display image is performed.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments in accordance with the invention will be described in detailwith reference to the following figures wherein:

FIG. 1 is a perspective view showing the outer structure of amultifunction peripheral according to an embodiment;

FIG. 2 is a block diagram showing an electrical configuration of themultifunction peripheral;

FIG. 3(a) is a view showing an example of a display screen of a touchpanel displaying thumbnail images;

FIG. 3(b) is a view showing an example of the display screen of thetouch panel displaying image process keys;

FIG. 3(c) shows a storage content of a position information storage areawhen the thumbnail images are displayed on the touch panel;

FIG. 3(d) shows a storage content of the position information storagearea when the image process keys are displayed on the touch panel;

FIG. 4 is a view schematically showing a configuration of a determinedimage process storage area;

FIG. 5 is a flowchart showing a thumbnail image display process executedby the multifunction peripheral;

FIG. 6(a) shows an example of the display screen of the touch paneldisplaying the image process keys when an image process key is touchedby a user;

FIG. 6(b) shows an example of a display screen of the touch panel when adetermination key is touched by the user;

FIG. 6(c) shows an example of the display screen of the touch panel whenthe steps S12 is executed;

FIG. 6(d) is a view showing an example of the display screen of thetouch panel on which a thumbnail image that has been touched by the useris replaced with a thumbnail image representing a result of an imageprocess result “sepia”;

FIG. 6(e) is a view showing an example of the display screen of thetouch panel where the selected thumbnail image representing the resultof the image process “sepia” is replaced with a thumbnail imagerepresenting a result obtained by canceling the image process “sepia”;

FIG. 6(f) is a view showing an example of the display screen whichdisplays a message in a dialogue area;

FIG. 7(a) is a view showing an example of the display screen of thetouch panel when two image processes “sepia” and “left-handed rotation”have been determined;

FIG. 7(b) is a view showing an example of the display screen of thetouch panel showing a result of the image process when two imageprocesses “sepia” and “left-handed rotation” are simultaneously appliedto the thumbnail image;

FIG. 7(c) is a view showing an example of the display screen of thetouch panel in the multifunction peripheral according to a secondembodiment; and

FIG. 8 is a flowchart showing a part of thumbnail image display processperformed in the multifunction peripheral according to the secondembodiment.

DETAILED DESCRIPTION

A first embodiment of the invention will be described while referring tothe accompanying drawings. FIG. 1 is a perspective view showing theouter structure of a multifunction peripheral (MFP) 1 according to theembodiment. As shown in FIG. 1, the multifunction peripheral 1 isintegrally configured of a printer 2 disposed on the bottom, a scanner 3disposed on the top, and a control panel 4 provided on the front surfaceof the scanner 3. The multifunction peripheral 1 implements a copierfunction, and a facsimile function, a printer function to record (print)image based on data received from external devices such as a personalcomputer (PC) on a recording sheet.

The multifunction peripheral 1 includes a connection panel 70 below thecontrol panel 4. The connection panel 70 has a USB terminal 71 on theleft end side thereof. The USB terminal 71 is a connector terminal forcommunicably connecting the multifunction peripheral 1 to an externaldevice through a USB connection. The connection panel 70 has a slotportion 72 on the right end side thereof. The slot portion 72 includes aplurality of card slots into which a memory card (card-type memory) canbe inserted. When a memory card is inserted into one of the card slots,image data is read out by a controller 20 (see FIG. 2) to be describedlater from the inserted memory card.

The control panel 4 is provided on the front side of the multifunctionperipheral 1. The control panel 4 is used for a user to operate theprinter 2 or the scanner 3. The control panel 4 includes variousoperation keys 40 and a touch panel 41. The user can input a desiredinstruction by using the control panel 4. When a prescribed instructionis input to the multifunction peripheral 1, the operation of themultifunction peripheral 1 is controlled by the controller 20 (see FIG.2) based on the input information.

The touch panel 41 has a screen on which various images are displayedand detects a contact of an indicator 42 (see FIGS. 3(a) to 3(d)) suchas a finger or a pen with the screen. The user brings the indicator 42into contact (touch) with information displayed on the touch panel 41 soas to input his or her desired instruction.

An electrical configuration of the multifunction peripheral 1 accordingto the embodiment will next be described with reference to FIG. 2. FIG.2 is a block diagram showing the electrical configuration of themultifunction peripheral 1. The multifunction peripheral 1 includes aparallel interface (I/F) 29 and the USB terminal 71. The parallelinterface 29 is an interface connectable to a PC via a cable. The USBterminal 71 is connectable to a digital camera. The slot portion 72 candetachably mount an external medium (e.g., storage medium such as amemory card or hard disk). With this configuration, image data can beinput from the PC, the digital camera, and the external medium to themultifunction peripheral 1. The connection configuration between themultifunction peripheral 1 and the abovementioned devices (PC, digitalcamera, external medium) is not limited to this. For example, themultifunction peripheral 1 may be connected to the abovementioneddevices via a not shown network I/F.

The controller 20 functions to control the overall operations of themultifunction peripheral 1, including the printer 2, the scanner 3, andthe control panel 4 (see FIG. 1). The controller 20 is configured of amicrocomputer primarily including a central process unit (CPU) 21, aread-only memory (ROM) 22, a random access memory (RAM) 23, and anelectrically erasable and programmable ROM (EEPROM) 24, which is arewritable, nonvolatile storage device. The controller 20 is connectedto an application specific integrated circuit (ASIC) 26 via a bus 25.

The CPU 21 is a central process unit for controlling the entireoperation of the multifunction peripheral 1. The ROM 22 stores variouscontrol programs executed by the CPU 21 and fixed values used when theprograms are executed. The ROM 22 stores a thumbnail image displayprogram 221 serving as an image process program. A thumbnail imagedisplay process to be described later using FIG. 5 is executed by thethumbnail image display program 221.

The RAM 23 is a rewritable memory used as a memory area for temporarilystoring various data or working area when the CPU 21 executes the aboveprogram. The RAM 23 has a load area for storing the program which isinstructed to be loaded upon activation of the multifunction peripheral1.

The RAM 23 further has an image file temporary storage area 230, animage process type storage area 231, a position information storage area232, a selected image storage area 233, and a determined image processstorage area 234.

The image file temporary storage area 230 is an area for storing animage file read out from a memory card (not shown) inserted into theslot portion 72. In the embodiment, the image file to be stored in theimage file temporary storage area 230 is, for example, JPEG image datawhich has original image data and thumbnail data that is for displayingthe image file (the original image) in a reduced size as additionalinformation.

With reference to FIG. 3(a), thumbnail images 411 which are displayed onthe touch panel 41 based on the thumbnail data added to respective imagefiles will be described below. FIG. 3(a) is a view showing an example ofa display screen of the touch panel 41 displaying the thumbnail images411. Since each of the thumbnail images 411 is a reduced sample imagecorresponding to each image file read in the image file temporarystorage area 230, a large number of thumbnail images 411 can be arrangedin a matrix on the touch panel 41, as shown in FIG. 3(a). In FIG. 3(a),12 thumbnail images 411 are arranged in a 3×4 matrix.

In the embodiment, the display area of the touch panel 41 is dividedinto a selection area 413 and a dialogue area 414. The thumbnail images411 are displayed in the selection area 413, while a message to the userand operation keys 412 are displayed in the dialogue area 414. In theexample of FIG. 3(a), a determination key 4121 and a cancel key 4122 aredisplayed as the operation keys 412. The user touches one of theoperation keys 412 to thereby make a desired input operation. In theembodiment, the images, such as the determination key 4121 and thecancel key 4122, which are displayed in the dialogue area 414 and whichare touched by the user for input of a specific instruction arecollectively referred to as operation keys 412.

Returning to FIG. 2, the image process type storage area 231 is an areafor storing image process that has been selected from among the imageprocess that the multifunction peripheral 1 can execute. Themultifunction peripheral 1 can apply a plurality of kinds of imageprocess to the image file stored in the image process type storage area231. The image process that the multifunction peripheral 1 can executeincludes, for example, “right-handed rotation” that rotates an image inthe right-handed direction, “left-handed rotation” that rotates an imagein the left-handed direction, “sepia” that corrects the tone of an imageinto sepia tone, “order specification” that creates order information toimages, “frameless” that eliminates a margin portion of an image, “redeye correction” that removes red eye from an image, “monochrome” thatconverts a color image into a monochrome one, “date stamping” thatstamps date onto an image, “framed” that provides a predetermined marginportion on an image, and “exposure compensation” that compensates thebrightness of an image.

With reference to FIG. 3(b), image process keys 415 will be describedbelow. FIG. 3(b) is a view showing an example of a display screen of thetouch panel 41 displaying the image process keys 415. The image processkeys 415 are displayed on the touch panel 41 so as to allow the user todesignate the image process to be applied. As shown in FIG. 3(b), theimage process keys 415 are arranged in a matrix. The image process keys415 one-to-one correspond to a plurality of image process that themultifunction peripheral 1 can execute. The user selects a given imageprocess key 415 from among the plurality of image process keys displayedon the touch panel 41 and brings the indicator 42, such as a finger,into contact (touch) with the selected image process key 415 displayedon the touch panel 41 so as to instruct image process corresponding tothe selected image process key 415. In other words, as shown in FIGS.3(a) and 3(b), the selection area 413 has 3×4 divided areas that areobtained by dividing the selection are 413 into 3 rows and 4 columns. Asshown in FIG. 3(a), each of 3×4 areas displays the thumbnail image 411.As shown in FIG. 3(b), each of 3×4 areas displays the image process key415.

The image process key 415 touched by the user is lit up like the imageprocess key 415 of “sepia” shown in FIG. 3(b), so as to be distinguishedfrom other image process keys 415. As a result, even if the user touchesa wrong key, he or she can quickly recognize the operation error.

The selected image processes are stored in the image process typestorage area 231 when the user touches, so as to determine the selectedimage processes, the determination key 4121 displayed as the operationkey 412 on the touch panel 41 in which one or a plurality of imageprocesses are selected.

Returning to FIG. 2, the position information storage area 232 is anarea for storing a correspondence between image (for example, thethumbnail image) displayed on the touch panel 41 and positioninformation of the image.

FIGS. 3(c) and 3(d) are views each schematically showing a configurationof the position information storage area 232. FIG. 3(c) shows thestorage content of the position information storage area 232 when thethumbnail images 411 are displayed on the touch panel 41, and FIG. 3(d)shows the storage content of the position information storage area 232when the image process keys 415 are displayed on the touch panel 41.

As shown in FIGS. 3(c) and 3(d), the position information storage area232 stores a coordinate serving as position information indicating theposition of each rectangular area that is obtained by divining thedisplay area of the touch panel 41 into, for example, a 3×6 matrix (3rows and 6 columns).

The coordinate stored in the position information storage area 232 isrepresented by an x-coordinate and a y-coordinate in a coordinate systemwhere the observer's lower right of the touch panel 41 is set as theorigin, a horizontal direction is set as an x-axis, and a verticaldirection is set as a y-axis. In FIG. 3(c), a coordinate in whichx-coordinate is i and y-coordinate is j is represented as XiYj where iand j are natural numbers. The touch panel 41 detects a contact of theindicator 42 therewith based on, e.g., a pressure applied thereto andoutputs a coordinate of the position at which the contact is detected.

Further, when the thumbnail images 411 are displayed on the touch panel41 as shown in FIG. 3(a), image file names (P₁, P₂, . . . ) of thethumbnail images 411 displayed at their respective coordinates arestored in the position information storage area 232 in association withthe respective coordinates, as shown in FIG. 3(c).

Further, when the image process keys 415 are displayed on the touchpanel 41 as shown in FIG. 3(b), image process names corresponding to theimage process keys 415 displayed at their respective coordinates arestored, in place of the abovementioned image file name, in the positioninformation storage area 232 in association with the respectivecoordinates, as shown in FIG. 3(d).

Thus, by referring to the position information storage area 232 based onthe coordinate corresponding to the contact position output by the touchpanel 41, the thumbnail image 411 or the image process selected by theuser can be identified.

For example, as shown in FIG. 3 (d), the image process name“right-handed rotation” is associated with a coordinate X3Y2 on theposition information storage area 232, so that when the user touches the“right-handed rotation” key displayed at the coordinate X3Y2, the CPU 21determines that the user instructs to select “right-handed rotation”based on the coordinate.

Returning to FIG. 2, the selected image storage area 233 is an area forstoring information indicating whether each of the thumbnail images 411displayed on the touch panel 41 is a selected thumbnail image which hasbeen selected by the user or a non-selected thumbnail image which hasnot been selected by the user. Details of the “selected thumbnail image”and “non-selected thumbnail image” will be described later withreference to FIG. 5.

The determined image process storage area 234 is an area for storinginformation (attribute information) indicating the image process whichhas been determined to be applied to each image file stored in the imagefile temporary storage area 230.

FIG. 4 is a view schematically showing a configuration of the determinedimage process storage area 234. When the user determines, by using thetouch panel 41, an image process and an image file to which thedetermined image process is to be applied, the determined image processis stored as attribute information of the determined image file. Forexample, since, as shown in FIG. 4, an image files P₁ is associated with“sepia” as the attribute information in the determined image processstorage area 234, the image process “sepia” are applied to the imagefile P₁. Further, since image file P₂ is associated with the “sepia” and“right-handed rotation” as the attribute information in the determinedimage process storage area 234, the image processes “sepia” and“right-handed rotation” are applied to the image file P₂.

Returning to FIG. 2, the ASIC 26 will be described below. The ASIC 26 isconnected to the controller 20 via the bus 25. A panel gate array (panelGA) 27 for controlling the operation keys 40 used for the user to inputhis or her desired instruction to the multifunction peripheral 1 isconnected to the ASIC 26. The panel gate array 27 detects a depression(input operation) of a operation key 40 and outputs a prescribed codesignal. Each of operation keys 40 is assigned to a respective codesignal (key code). Upon receiving a prescribed key code from the panelgate array 27, the CPU 21 performs requested control process accordingto a prescribed key process table.

A touch panel controller 28 is connected to the ASIC 26. The touch panelcontroller 28 is for controlling the display screen of the touch panel41. The touch panel controller 28 displays, under the control of the CPU21, an image corresponding to data received from a connected externaldevice or a memory card inserted into the slot portion 72.

Further, an NCU (Network Control Unit) 31 is connected to the ASIC 26.The NCU 31 is connected to a general public line (not shown) so as torealize a facsimile function. In addition, a modem 32 is connected, viathe NCU 31 to the ASIC 26.

Next, with reference to FIG. 5 and FIGS. 6(a) to 6(f), the thumbnailimage display process will be described. The thumbnail image displayprocess is executed in the multifunction peripheral 1 having theconfiguration described above. FIG. 5 is a flowchart showing thethumbnail image display process executed by the multifunction peripheral1, and FIGS. 6(a) to 6(f) are views showing the transition of thedisplay of the touch panel 41. In the following, the flowchart of FIG. 5will be described with appropriate reference to FIGS. 6(a) to 6(f).

The thumbnail image display process is executed when a memory card isinserted into the slot portion 72 by the user to cause image filesstored in the memory card is loaded into the image file temporarystorage area 230 (see FIG. 2). When the cancel key 4124 is touched bythe user during execution of the thumbnail image display process, thisthumbnail image display process is ended.

First, in S2 the CPU 21 controls the touch panel 41 to display m imageprocess keys 415 (see FIG. 3(b)) in the selection area 413. The “m” is apredetermined natural number equal to or more than 2. When the number ofimage processes to be displayed as choices exceeds the “m”, i.e., whenthe image process keys 415 corresponding to all the image processescannot be displayed, a cursor key (not shown) may be used to scroll upand down the image process keys 415. FIG. 6(a) shows an example of thetouch panel 41 displaying the image process keys 415 to change the imageprocesses keys 415. In this example, 12 image process keys 415 aredisplayed.

Returning to FIG. 5, and description will now be continued. In S4 theCPU 21 determines whether or not any of image process key 415 has beentouched. Concretely, the CPU 21 detects a contact of the indicator 42with the touch panel 41, and determines whether or not the x-coordinateof the contact position falls between 0 and 3.

When there is a touch on the given image process key 415 (S4: Yes), thatis, the CPU 21 detects a contact of the indicator 42 with the touchpanel 41, and determines that the x-coordinate of the contact positionfalls between 0 and 3, in S6 the CPU 21 light up the touched imageprocess key 415. Then, in S8 the CPU 21 determines whether or not thedetermination key 4121 displayed at a coordinate (4,0) has been touched.When the determination key 4121 has not been touched (S8: No), the CPU21 returns to S4, and repeats steps S4 and subsequent process.Accordingly, when another image process key 415 is touched (S4: Yes),the CPU 21 light up the touched image process key 415. When any of theimage process keys 415 have not been touched (S4: No), the CPU 21 skipsS6 and proceeds to S8.

When the user has selects all the desired image process, and touches thedetermination key 4121 in a state where at least one image process key415 is lit up (S8: Yes), in S10 the CPU 21 stores, in the image processtype storage area 231, each image process corresponding to the lit upimage process key 415, that is, image process selected by the user.

FIG. 6(b) shows an example of a display screen of the touch panel 41when the determination key 4121 is touched by the user. As shown in FIG.6(b), the user selects a given image process (in this example, “sepia”)and touches the determination key 4121 to thereby determine any of theplurality of image processes that can be executed by the multifunctionperipheral 1.

Returning to FIG. 5, in S12 the CPU 21 switches the display in theselection area 413 on the touch panel 41 from the m image process keys415 to m thumbnail images 411.

When the number of the image files that have been loaded is less than m,thumbnail images 411 corresponding to all the loaded image files aredisplayed on the touch panel 41. When the number of the image files thathave been loaded exceeds the “m”, i.e., when thumbnail images 411corresponding to all the image files cannot be displayed, a cursor key(not shown), for example, may be used to scroll up and down thethumbnail images 411 to change the thumbnail images 411.

FIG. 6(c) shows an example of a display screen of the touch panel 41when the process of S12 is executed. As shown in FIG. 6(c), when thethumbnail images 411 are displayed, a message, such as “sepia is beingapplied” is displayed so as to allow the user to confirm the imageprocess that has been determined is displayed in the dialogue area 414.Thus, the user can select the thumbnail image while visually confirmingthe image process to be applied.

Returning to FIG. 5, in S14 the CPU 21 determines whether or not any ofthumbnail images 411 displayed on the touch panel 41 has been touched.That is, the touch panel 41 detects the thumbnail image 411 is touched,and then the CPU 21 receives the selection instruction to select thethumbnail image 411 based on the detection of the touch panel 41.

When the CPU 21 determines that the thumbnail image 411 has been touchedby the user (S14: Yes), in S16 the CPU 21 refers the selected imagestorage area 233 that stores information indicating whether each of thethumbnail images 411 is the selected thumbnail image or non-selectedthumbnail image. Accordingly, the CPU 21 determines whether or not thetouched thumbnail image 411 is the selected thumbnail image that hasbeen selected by the user.

In the initial state, since no selected thumbnail image is displayed onthe touch panel 41, the touched thumbnail image 411 is determined not tobe the selected thumbnail image (S16: No). Thus, this case (S16: No)will be described. In this case, in S22 the CPU 21 lights up the touchedthumbnail image and replaces the touched thumbnail with a thumbnailimage representing a result of the image process stored, in associationwith the touched image, in the image process type storage area 231.

Then, in S26 the CPU 21 stores information indicating that the touchedthumbnail image is the selected thumbnail image in the selected imagestorage area 233, and the CPU 21 proceeds to S28. In the description,the thumbnail image 411 touched by the user and representing a result ofthe image process stored in the image process type storage area 231 isreferred to as “selected thumbnail image” and thumbnail image that hasnot been touched by the user, that is, thumbnail image which is not the“selected thumbnail image” is referred to as “non-selected thumbnailimage”.

FIG. 6(d) is a view showing an example of a display screen on which thethumbnail image that has been touched by the user is replaced, in thestep S22, with a thumbnail image representing the image process result.As shown in FIG. 6(d), when the user instruct to select the thumbnailimage 411, the selected thumbnail image 411 is replaced with a thumbnailimage 411 representing a result of the image process (in this case,“sepia” process) that has been previously determined, on the image datacorresponding to the selected thumbnail image 411. With thisconfiguration, the user can visually confirm a result of the imageprocess in a moment only by touching the thumbnail image 411. Since thethumbnail images other than the thumbnail image that has been touched bythe user are displayed without modification at the same positions.Accordingly, the user can visually confirm a relationship between thethumbnail image representing the image process result and otherthumbnail images to thereby determine, in a comprehensive manner, theinfluence exerted by the image process.

In the embodiment, the image process stored in the image process typestorage area 231 is applied to the thumbnail data added to each imagefile to obtain thumbnail data that has been subjected to the imageprocess. A thumbnail image (e.g., thumbnail image subjected to imageprocess “sepia”) representing the process result is displayed based onthe obtained thumbnail data. Alternatively, the image process stored inthe image process type storage area 231 may be applied to an image filewhich is the original data of the thumbnail image 411 to obtain an imagefile that has been subjected to the image process. In this case,thumbnail data is created from the obtained image file. A thumbnailimage representing the image process result is displayed based on thecreated thumbnail data.

Returning to FIG. 5, in S28 the CPU 21 determines whether or not thedetermination key 4121 displayed at the coordinate (4,0) has beentouched. When the determination key 4121 has not been touched (S28: No),the CPU 21 returns to S14, where the determination process is repeated.That is, every time a thumbnail image 411 is touched (S14: Yes), in S16the CPU 21 determines whether the touched thumbnail image is theselected thumbnail image. When the touched thumbnail image 411 is notthe selected thumbnail image (S16: NO), in S22 the CPU 21 replaces thetouched thumbnail image with a thumbnail image representing a result ofthe image process stored, in association with the touched image, in theimage process type storage area 231.

Thus, the user can visually confirm the result of the image process thathas been determined to be applied to the touched thumbnail image 411 ina moment only by a simple operation of only touching the thumbnail image411. Further, every time a thumbnail image 411 is touched by the user,the touched thumbnail image 411 is substituted with a thumbnail image411 representing a result of the image process, so that only a smallnumber of operation is required even in the case where results of theimage process applied to a large number of thumbnail images 411 arerequired to be confirmed, resulting in good operability.

Next, a case (S16: Yes) where the thumbnail image 411 that has beentouched by the user is determined to be the selected thumbnail imagewill be described. As described above, the selected thumbnail image isdisplayed in a state showing a result when the image process, that isstored in the image process type storage area 231, is performed on theimage data corresponding to the selected thumbnail image. Thus, whensuch a selected thumbnail image is touched, in S18 the CPU 21 replacesthe touched thumbnail image with a thumbnail image 411 representing aresult of process obtained by canceling the image process stored in theimage process type storage area 231, i.e., most recently determinedimage process. In other words, the CPU 21 replaces the touched thumbnailimage representing the result of the image process performed on theimage data, with the thumbnail image 411 representing the image datawithout performing the image process stored in the image process typestorage area 231 when the selected thumbnail image is touched by theuser. In S20 the CPU 21 stores the thumbnail image that has been touchedby the user in the selected image storage area 233 as the non-selectedthumbnail image.

FIG. 6(e) is a view showing an example of a state where one selectedthumbnail image representing a result of the image process “sepia” isreplaced with a thumbnail image 411 representing a process resultobtained by canceling the image process “sepia” when the user touchesthe selected thumbnail image. As shown in FIG. 6(e), a simple operationof touching the selected thumbnail image allows the user to confirm aresult of image process obtained by canceling the image process storedin the image process type storage area 231. As a result, the user canadequately determine whether or not the intended image process isapplied to image data corresponding to the thumbnail image.

Returning to FIG. 5, in S28 the CPU 21 determines whether or not thedetermination key 4121 displayed at the coordinate (4,0) has beentouched by the user. When the CPU 212 determines that the determinationkey 4121 has not been touched (S28: No), the CPU 21 returns to S14, andthe step S14 and subsequent steps are repeated.

When the CPU 21 determines that the determination key 4121 displayed atthe coordinate (4,0) is touched in the above repetition (S28: Yes), inS30 the CPU 21 stores, during the determined image process storage area234 (see FIG. 4), the image process that is stored in the image processtype storage area 231 as attribute information of an image filecorresponding to the selected thumbnail image. According to theattributed information, the image process determined by the user isexecuted for respective image files.

Subsequently, in S32 the CPU 21 controls the touch panel 41 to display,in the dialogue area 414, a message inquiring whether or not there issubsequent process.

FIG. 6(f) is a view showing an example of a state where the message isdisplayed in the dialogue area 414 by the process of S32. As shown inFIG. 6(f), two operation keys 412 of “Yes” (4122) and “No” (4121) aredisplayed in the dialogue area 414 so as to allow the user to input hisor her answer to the message.

Returning to FIG. 5, when the CPU 21 determines that the operation key412 of “No” has been touched (S34: No), the CPU 21 ends the process.

When the CPU 21 determines that the operation key 412 of “Yes” has beentouched (S34: Yes), in S36 the CPU clears the image process type storagearea 231. In S38 the CPU 21 stores, in the selected image storage area233, all the thumbnail images as the non-selected thumbnail images.Subsequently, the CPU 212 returns to S2, where the CPU 21 switches thedisplay in the selection area 413 on the touch panel 41 from the screendisplaying thumbnail images 411 to the screen displaying the imageprocess keys 415, and subsequent steps are repeated.

According to the above procedure, when the user newly determines his orher desired image process, the newly determined image process is storedin the image process type storage area 231 (see FIG. 2). That is, onlythe image process that has most recently been determined is alwaysstored in the image process type storage area 231. Then, by repeatingthe same operation procedure, a result of the newly determined imageprocess for a given thumbnail image 411 can be confirmed. Thus, with asimple operation, a result of various types of image process canvisually be confirmed.

When in S14 a new image process is selected and determined, thethumbnail images 411 are displayed on the touch panel 41. At this time,if determined image process corresponding to some thumbnail image 411 isstored in the determined image process storage area 234 as the attributeinformation, this thumbnail image 411 is displayed in a state showing aresult of image process on the image file corresponding to thisthumbnail image 411. This allows the user to consider whether or not toadd another image process while visually confirming the result of thedetermined image process by the thumbnail images 411.

FIGS. 7(a) to 7(c) are views showing an example of a display screen ofthe touch panel 41 when two or more image process have been determinedin the process from S4 to S10. As shown in FIG. 7(a), when thedetermination key 4121 is touched with the “left-handed rotation” and“sepia” selected, the “left-handed rotation” and “sepia” aresimultaneously applied to the touched thumbnail image 411 as shown inFIG. 7(b). As described above, even in the case where a plurality ofimage process are selected and determined, the user can visually confirmin a moment a result of the applied image process.

Further, in the operation procedure according to the embodiment, asshown in FIG. 7(a), the image process keys 415 are first displayed onthe touch panel 41. When some image process is selected and thedetermination key 4121 is touched, the image process keys 415 aredisappeared from the touch panel 41. Then, as shown in FIG. 7(b), thethumbnail images 411 are displayed on the touch panel 41. Thisconfiguration effectively utilizes a limited space of the touch panel41, thereby largely displays the thumbnail images 411 and image processkeys 415 in an easy to view manner. Further, the image process keys 415and thumbnail images 411 are both displayed at the same area (in theselection area 413), so that the user needs only to pay attention to theselection area 413, resulting in good visibility.

Further, in the embodiment, the image process keys 415 are displayed inthe selection area 413 on the touch panel 41 in a 3×4 matrix (3 rows and4 columns), and the thumbnail images 411 are displayed in a 3×4 matrix(3 rows and 4 columns) as well. That is, the image process keys 415 andthumbnail images 411 are arranged in the same layout. Thus, even in thecase where the display is switched from process keys 415 to thumbnailimages 411, or conversely, where the display is switched from thethumbnail images 411 to image process keys 415, the user needs only topay attention to a change in the same area, resulting in goodvisibility. Further, the user needs only to pay attention to theoperation in the same area, resulting in good operability. Thus, theuser can continue performing operation without experiencing discomforteven when the display state is switched.

Next, with reference to FIG. 7(c) and FIG. 8, a control processperformed by the multifunction peripheral 1 according to a secondembodiment will be described. In the multifunction peripheral 1according to the second embodiment, thumbnail images before and afterimage process corresponding to a touched thumbnail image are displayedside-by-side. In the second embodiment, the same reference numerals asthe first embodiment are given to the parts which are common to thefirst embodiment, and the overlapped description is omitted.

FIG. 8 is a flowchart showing a part of thumbnail image display processperformed in the multifunction peripheral 1 according to the secondembodiment. The thumbnail image display process according to the secondembodiment differs from that of the first embodiment in that steps fromS140 to S280 shown in FIG. 8 are executed in place of the steps from S14to S28 in the flowchart shown in FIG. 5.

The flowchart shown in FIG. 8 shows the process after S12 of FIG. 5,that is, after the user selects and determines an image process, and thethumbnail images 411 are displayed in the selection area 413 on thetouch panel 41.

First, in S140 the CPU 21 determines whether or not the thumbnail image411 displayed on the touch panel 41 has been touched. When the CPU 21determines that the thumbnail image 411 has been touched by the user(S140: Yes), in S150 the CPU 21 determines whether or not the touchedthumbnail image 411 is the selected thumbnail image. When the CPU 21determines that the touched thumbnail image 411 is the selectedthumbnail image (S150: Yes), the CPU 21 returns to S140 and the stepsS140 and subsequent steps are repeated.

On the other hand, when the CPU 21 determines that the touched thumbnailimage is not the selected thumbnail image (S150: No), in 5160 the CPU 21lights up the touched thumbnail image 411. The CPU 21 controls the touchpanel 41 to display, at a coordinate (4,0) in the dialogue area 414, aprocessed thumbnail image 416 (see FIG. 7(c)) that representing a resultafter the image process, which is stored in the image process typestorage area 231 is performed on the image data corresponding to thetouched thumbnail image 411.

In S180 the CPU 21 controls the touch panel 41 to display, at acoordinate (5,0) in the dialogue area 414, an unprocessed thumbnailimage 417 representing the image before image process is performed, thatis, the thumbnail image at the time when the thumbnail image 411 istouched by the user, or the same thumbnail image as the touchedthumbnail image 411.

FIG. 7(c) is a view showing an example of a display screen of the touchpanel 41 in the multifunction peripheral 1 according to the secondembodiment. As shown in FIG. 7(c), when one thumbnail image 411 istouched, the processed thumbnail image 416 and the unprocessed thumbnailimage 417, which correspond to the touched thumbnail image 411, aredisplayed in the dialogue area 414. As can be seen from FIG. 7(c), theprocessed thumbnail image 416 and the unprocessed thumbnail image 417have the same size and are arranged side-by-side in the dialogue area414. In other words, the processed thumbnail image 416 and theunprocessed thumbnail image 417 have the same reduction ratio to animage size of the original image data. With this configuration, the usereasily compares the two thumbnail images to thereby adequately determinewhether or not to apply the image process. Further, as described later,the processed thumbnail image 416 and the unprocessed thumbnail image417 function also as the operation key 412.

Returning to FIG. 8, in S190 the CPU 21 determines whether or not theunprocessed thumbnail image 417 has been touched. When the unprocessedthumbnail image 417 has been touched (S190: Yes), in S200 the CPU 21erases the processed thumbnail image 416 and the unprocessed thumbnailimage 417, instead, displays the operation key 412 such as thedetermination key 4121 and cancel key 4122, and a massage inquiringwhether or not the current image process is determined. Subsequently, inS280 the CPU 21 determines whether or not the determination key 4121displayed at the coordinate (4,0) has been touched by the user. When theCPU 21 makes a positive determination, that is, the CPU 21 determinesthat the determination key 4121 at the coordinate (4, 0) has beentouched (S280: Yes), the CPU 21 proceeds to S30 of the flowchart shownin FIG. 5. When the CPU 21 makes a negative determination, that is, theCPU 21 determines that the determination key 4121 at the coordinate (4,0) has not been touched, the CPU 21 returns to S140.

On the other hand, when the CPU 21 determines that the unprocessedthumbnail image 417 displayed in the dialogue area 414 has not beentouched (S190: No), in S210 the CPU 21 determines whether or not theprocessed thumbnail image 416 in the dialogue area 414 has been touched.When the CPU 21 determines that the processed thumbnail image 416 hasbeen touched (S210: Yes), the CPU 21 controls the touch panel 41 toreplace the touched thumbnail image 411 in the selection area 413 withthe unprocessed thumbnail image 417. Subsequently, in 5230 the CPU 21stores the replaced thumbnail image 411 as the selected thumbnail imagein the selected image storage area 233, and the CPU 21 proceeds to S200.

When the CPU 21 determines that the unprocessed thumbnail image 417displayed in the dialogue area 414 has not been touched (S190: No), andwhen the CPU 21 determines that the processed thumbnail image 416displayed in the dialogue area 414 has not been touched (S210: No), theCPU 21 proceeds to S200.

In the multifunction peripheral 1 according to the second embodiment,the processed thumbnail image 416 and the unprocessed thumbnail image417 are simultaneously displayed. This allows the user to adequatelydetermine whether or not to apply the image process to image datacorresponding to the processed thumbnail image 416 and the unprocessedthumbnail image 417.

While the invention has been described in detail with reference to theabove embodiments thereof, it would be apparent to those skilled in theart that various changes and modifications may be made therein withoutdeparting from the spirit of the invention.

For example, although the touch panel 41 provided in the multifunctionperipheral 1 is configured to detect a contact of the indicatortherewith in the above embodiments, the invention may be applied to casewhere a touch panel configured to detect proximity of the indicatorthereto.

Further, in the above embodiments, image files stored in the memory cardare loaded into the image file temporary storage area 230 (see FIG. 2),and the thumbnail images 411 in the respective image files are displayedon the touch panel 41. Alternatively, the invention may suitably beapplied to a configuration in which thumbnail data is created from imagedata scanned by the scanner 3 and thumbnail images corresponding to thecreated image data are displayed on the touch panel 41. Or, theinvention may also be applied to a configuration in which thumbnailimages in respective image files received from an external device aredisplayed on the touch panel 41.

Further, in the first embodiment, when the touched thumbnail image 411is the selected thumbnail image, that is, an image representing a resultof the image process that has already been selected (S16: Yes), in S18the touched thumbnail image 411 is replaced with a thumbnail image 411representing a result of process obtained by canceling the most recentlyselected image process. Alternatively, when the user touches again theselected thumbnail image, the thumbnail image 411 is replaced with animage representing a result when the image process is applied to theimage data once again. For example, when the selected thumbnail imageshows a result of the image process “right-handed rotation” that isstored in the image process type storage area 231, the currentlydisplayed thumbnail image 411 represents a state where the “right-handedrotation” image process has already been performed on the image data.When the user further touches this selected thumbnail image again, thecurrent thumbnail image 411 (selected thumbnail image) may be replacedwith a thumbnail image 411 representing a state where the additional“right-handed rotation” image process has been performed on the imagedata.

Further, in the thumbnail image display process according to the firstembodiment, when a touched thumbnail image is a selected thumbnail image(S16: Yes), in S18 the touched thumbnail image is replaced with athumbnail image representing a result of process obtained by cancelingonly the most recently selected image process. Alternatively, thetouched thumbnail image may be replaced with a thumbnail imagerepresenting a result of process obtained by canceling all the selectedimage process.

What is claimed is:
 1. An image processing method comprising: (a)displaying a plurality of candidate image processes to be performed onimage data, the plurality of candidate image processes including a colormodification process; (b) receiving, after performing step (a), aninstruction indicating the color modification process selected fromamong the plurality of candidate image processes; (c) displaying adisplay image corresponding to the image data on the display, each ofthe plurality of candidate image processes displayed being independentof the displayed display image corresponding to the image data; (d)designating, after performing step (c), the display image; and (e)displaying, after performing both of steps (b) and (d), a processeddisplay image that represents a result of the selected colormodification process performed on the image data corresponding to thedesignated display image before the selected color modification processon the image data corresponding to the designated display image isperformed.
 2. The image processing method as claimed in claim 1, whereinthe plurality of candidate image processes further including anotherimage process different from the color modification process, wherein theimage processing method further comprises (f) displaying anotherprocessed display image that represents a result of the selected colormodification process and the another display image process performed atone time on the image data corresponding to the designated display imagebefore the selected color modification process and the another imageprocess on the image data corresponding to the designated display imageare performed.
 3. The image processing method as claimed in claim 1,wherein the color modification process is configured to correct tone ofthe image data into sepia tone.
 4. The image processing method asclaimed in claim 1, wherein in the step (d), the display image isdesignated based on a detection of an indicated position on a touchpanel.
 5. The image processing method as claimed in claim 1, furthercomprising: (g) receiving another instruction indicating anotherselected image process from among the plurality of candidate imageprocesses; (h) designating another display image; and (i) displayinganother processed display image that represents a result of the anotherselected process performed on the image data corresponding to theanother designated display image, wherein if, in the step (g), theanother instruction is received after the processed display image isdisplayed in the step (e) and if, in the step (h), the another displayimage is designated, the another processed display image is displayed inthe step (i).
 6. The image processing method as claimed in claim 1,further comprising: (j) detecting a prescribed operation by the user;and (k) switching from a display on which the display image is displayedvia the step (c) to a display on which the plurality of candidate imageprocesses is displayed via the step (a) in response to the prescribedoperation detected in the step (i).
 7. The image processing method asclaimed in claim 6, wherein the step (k) further includes (l) switchingfrom the display on which the plurality of candidate image processes isdisplayed via the step (a) to the display on which the display image isdisplayed via the step (c).
 8. The image processing method as claimed inclaim 6, wherein the plurality of candidate image processes and thedisplay image are displayed at a selection region of a display, whereinthe selection region has m×n divided regions that are obtained bydividing the selection region into m rows and n columns wherein m and nare natural numbers, wherein in the step (a) each of the image processesis displayed on one of the divided regions.
 9. The image processingmethod as claimed in claim 1, wherein the step (a) includes (m)replacing the designated display image with the processed display image,wherein the step (c) further includes (n) maintaining to display displayimages other than the designated display image at same positions. 10.The image processing method as claimed in claim 9, further comprising:(o) designating the processed display image as a designated displayimage, (p) replacing the processed display image with a display imagethat represents the image data without performing the selected colormodification process when in the step (o), the processed display imageis designated as the designated display image.
 11. The image processingmethod as claimed in claim 1, wherein the step (e) includes (q)displaying on a display the designated display image together with theprocessed display image corresponding to the designated display image.12. The image processing method as claimed in claim 11, wherein both thedisplayed designated display image and the processed display imagecorresponding to the displayed designated display image have a samereduction ratio to an image size of the image data.
 13. The imageprocessing method as claimed in claim 11, wherein the display image isdisplayed in a selection region of the display, and both the designateddisplay image and the processed display image corresponding to thedesignated display image are displayed in an information region of thedisplay, the image processing method further comprising: (r) designatingthe processed display image displayed on the information region as adesignated processed display image; and (s) replacing the designateddisplay image, displayed on the selection region, corresponding to thedesignated processed display image, with the designated processeddisplay image.
 14. The image processing method as claimed in claim 13,wherein in the step (r), the processed display image is designated asthe designated processed display image based on a detection of anindicated position on the display.
 15. An image processing apparatuscomprising: a display; a process display unit configured to display onthe display a plurality of candidate image processes to be performed onimage data, the plurality of candidate image processes including a colormodification process; a process receiving unit configured to receive,after the process display unit displays on the display the plurality ofcandidate image processes, an instruction indicating the colormodification process selected from among the plurality of candidateimage processes; an image display unit configured to display a displayimage corresponding to the image data on the display, each of theplurality of candidate image processes displayed being independent ofthe displayed display image corresponding to the image data; and animage designating unit configured to designate, after the image displayunit displays the display image corresponding to the image data on thedisplay, the display image, wherein the image display unit is configuredto display, after the process receiving unit receives the instructionand after the image designating unit designates the display image, aprocessed display image that represents a result of the selected colormodification process performed on the image data corresponding to thedesignated display image before the selected color modification processon the image data corresponding to the designated display image isperformed.
 16. The image processing apparatus as claimed in claim 15,wherein the plurality of candidate image processes further includinganother image process different from the color modification process,wherein the process display unit is further configured to displayanother processed display image that represents a result of the selectedcolor modification process and the another display image processperformed at one time on the image data corresponding to the designateddisplay image before the selected color modification process and theanother image process on the image data corresponding to the designateddisplay image are performed.
 17. The image processing apparatus asclaimed in claim 15, wherein the color modification process isconfigured to correct tone of the image data into sepia tone.
 18. Theimage processing apparatus as claimed in claim 15, wherein the imagedesignating unit designates the display image based on a detection of anindicated position on a touch panel.
 19. The image processing apparatusas claimed in claim 15, further comprising: an another instructionreceiving unit configured to receive another instruction indicatinganother selected image process from among the plurality of candidateimage processes; an another display image designating unit configured todesignate another display image; and an another processed display imagedisplaying unit configured to display another processed display imagethat represents a result of the another selected process performed onthe image data corresponding to the another designated display image,wherein if the another instruction receiving unit receives the anotherinstruction after the image display unit displays the processed displayimage and if the another display image designating unit designates theanother display image, the another processed display image displayingunit displays the another processed display image.
 20. The imageprocessing apparatus as claimed in claim 15, further comprising: adetection unit configured to detect a prescribed operation by the user;and a switching unit configured to switch a display on which the displayimage is displayed via the image display unit to a display on which theplurality of candidate image processes is displayed via the processdisplay unit in response to the prescribed operation detected by thedetecting unit.
 21. The image processing apparatus as claimed in claim20, wherein the switching unit is further configured to switch from thedisplay on which the plurality of candidate image processes is displayedvia the process display unit to the display on which the display imageis displayed via the image display unit.
 22. The image processingapparatus as claimed in claim 20, wherein the plurality of candidateimage processes and the display image are displayed at a selectionregion of a display, wherein the selection region has m×n dividedregions that are obtained by dividing the selection region into m rowsand n columns wherein m and n are natural numbers, wherein the processdisplay unit is configured to display each of the image processes on oneof the divided regions.
 23. The image processing apparatus as claimed inclaim 15, wherein the process display unit includes a replacing unitconfigured to replace the designated display image with the processeddisplay image, wherein the image display unit further includes amaintaining unit configured to maintain to display display images otherthan the designated display image at same positions.
 24. The imageprocessing apparatus as claimed in claim 23, further comprising: aprocessed display image designating unit configured to designate theprocessed display image as a designated display image, a display imagereplacing unit configured to replace the processed display image with adisplay image that represents the image data without performing theselected color modification process when the processed display imagedesignating unit designates the processed display image as thedesignated display image.
 25. The image processing apparatus as claimedin claim 15, wherein the image display unit is further configured todisplay, on a display, the designated display image together with theprocessed display image corresponding to the designated display image.26. The image processing apparatus as claimed in claim 25, wherein boththe displayed designated display image and the processed display imagecorresponding to the displayed designated display image have a samereduction ratio to an image size of the image data.
 27. The imageprocessing apparatus as claimed in claim 25, wherein the display imageis displayed in a selection region of the display, and both thedesignated display image and the processed display image correspondingto the designated display image are displayed in an information regionof the display, the image processing apparatus further comprising: aprocessed display image designating unit configured to designate theprocessed display image displayed on the information region as adesignated processed display image; and a display image replacing unitconfigured to replace the designated display image, displayed on theselection region, corresponding to the designated processed displayimage, with the designated processed display image.
 28. The imageprocessing apparatus as claimed in claim 27, wherein the processeddisplay image designating unit designates the processed display image asthe designated processed display image based on a detection of anindicated position on the display.